A Semi-Automatic Method for Resolving Occlusion in Augmented Reality

Realistic merging of virtual and real objects requires that the augmented patterns be correctly occluded by foreground objects. In this paper, we propose a semi-automatic method for resolving occlusion in augmented reality which makes use of key-views. Once the user has outlined the occluding objects in the key-views, our system detects automatically these occluding objects in the intermediate views. A region of interest that contains the occluding objects is first computed from the outlined silhouettes. One of the main contribution of this paper is that this region takes into account the uncertainty on the computed interframe motion. Then a deformable region-based approach is used to recover the actual occluding boundary within the region of interest from this prediction. Results and videos are available at the URL: http://www.loria.fr/ ̃lepetit/Occlusions.